Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BBT#442] Trimming and broadcast #355

Open
wants to merge 41 commits into
base: master
Choose a base branch
from
Open

[BBT#442] Trimming and broadcast #355

wants to merge 41 commits into from

Conversation

yu-pei
Copy link
Contributor

@yu-pei yu-pei commented Mar 21, 2022 •
edited
Loading

WIP of the broadcast for DTD, there's the code for DAG trimming as well. Moved from Bitbucket PR #442
https://bitbucket.org/icldistcomp/parsec/pull-requests/442

Currently based on an older version of PaRSEC.

yu-pei and others added 30 commits September 23, 2021 13:33
@yu-pei
create bcast key task class
3c92ede
@yu-pei
setting release dep func for BCAST KEY class
ef3117f
@yu-pei
added a sleep to have a temp solution for the last data flush iterate…
3f7320f 
… successor issue
@yu-pei
add in populate remote dep and check successors code for chain topology
db21cda
@yu-pei
handle calling iterate successor from get datatype
5345981
@yu-pei
node in the chain continue propagation; TODO: data, remote dep ref co…
95c9066 
…unt accounting
@yu-pei
add in some tile clean up on root node from data flush
0492882
@yu-pei
fixes tile accounting on nodes in the chain; TODO: clearn up of non p…
bcf2c35 
…articipating nodes
@yu-pei
not involved nodes calling TILE_OF will insert tile into hash table
1b7534e
@yu-pei
some code clean up
de4f299
@yu-pei
BCAST DATA task class piggyback to the normal workflow
3b2fd37
@yu-pei
clean up and add previous potrf test case
0728ed3
@yu-pei
key array propagate will need root rank info as part of key as well
ed5a53a
@yu-pei
fix issue of pending_ack for created remote_deps
5ad52fe
@yu-pei
fix issue in get successor rank; TODO: data copy and remote deps recycle
4396353
@yu-pei
window size limits the key bcast in current scheme; incresing as temp…
af22ab6 
… fix
allocating more bits for ranks
c11afe1
@yu-pei
hash table to store key arrays, still overfill task window
8bec4b0
@yu-pei
WIP: removing receiver task for key array, reduce tasks
a0d16b6
@yu-pei
use correct key to retrieve saved deps
f873ec7
@yu-pei
remove prints
31445b0
@yu-pei
clean up the not needed bcast release deps func
c46a57d
@yu-pei
move broadcast code into own file
c736fea
@yu-pei
move the bcast key/data task body to dtd_broadcast file
3d8e030
@yu-pei
move the bcast keys tile to be DTD internal
d3625dd
@yu-pei
switch to reuse PTG implementation
464c721
@yu-pei
linking bcast meta data to propagate bcast data with global ID
d56c3b9
@yu-pei
fix remote dep refcount issue
b1b6ce2
@yu-pei
minor update to test case
1b222f0
@yu-pei
changes to allow QR to work
92c2d35
@yu-pei yu-pei requested a review from bosilca as a code owner March 21, 2022 18:16
@abouteiller
Copy link
Contributor

Is this a replacement for https://bitbucket.org/icldistcomp/parsec/pull-requests/442 ?

If so can you mark it accordingly in the title ([BBT#442]), add a link at the top of the first comment, and close it on bitbucket with a link to this PR as the comment.

@yu-pei yu-pei changed the title Trimming and broadcast [BBT#442] Trimming and broadcast Mar 23, 2022
@yu-pei yu-pei requested a review from a team as a code owner April 1, 2022 17:08
bosilca referenced this pull request Feb 21, 2023
@abouteiller
Make collective topology a runtime option
f895408
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bosilca bosilca Awaiting requested review from bosilca

At least 2 approving reviews are required to merge this pull request.

Assignees

@yu-pei yu-pei

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@yu-pei @abouteiller